Emergent Properties in Structurally 
Dynamic Disordered Cellular Networks 



Thomas Nowotny 



Manfred Requardt 



Institute for Nonlinear Science 

University of California San Diego 

Mail code 0402 

9500 Gilman Dr. 

La Jolla, CA 92093-0402 USA 

(E-mail: tnowotny@ucsd.edu) 



Institut fur Theoretische Physik 
Universitat Gottingen 
Friedrich-Hund-Platz 1 
37077 Gottingen Germany 
(E-mail: 

requardt@theorie. physik. uni- 
goettingen.de) 



Abstract 

We relate structurally dynamic cellular networks, a class of models 
we developed in fundamental space-time physics, to SDCA, introduced 
some time ago by Ilachinski and Halpern. We emphasize the crucial 
property of a non-linear interaction of network geometry with the mat- 
ter degrees of freedom in order to emulate the supposedly highly erratic 
and strongly fluctuating space-time structure on the Planck scale. We 
then embark on a detailed numerical analysis of various large scale 
characteristics of several classes of models in order to understand what 
will happen if some sort of macroscopic or continuum limit is per- 
formed. Of particular relevance in this context is a notion of network 
dimension and its behavior in this limit. Furthermore, the possibility 
of phase transitions is discussed. 



1 Introduction 



In the beautiful book pQ the title of chapter 12 reads: "Is Nature, underneath 
it All, a CA?" . Such ideas have in fact been around for quite some time (cf. 
e.g. [2])|3],[1] or [5], to mention a few references). A little bit later 't Hooft 
analysed the possibility of deterministic CA underlying models of quantum 
field theory or quantum gravity ([6] and [7] are two examples from a long 
list of papers). For more detailed historical information see [T] or [8]. A nice 
collection of references can also be found in [9]. However, we would like to 
issue a warning against an overly optimistic attitude. While we share the 
general philosophy uttered in these works, there are some subtle points as 't 
Hooft remarks correctly ([TO]). It is no easy task to incorporate something as 
complex as the typical entanglement structure of quantum theory into the, at 
first glance, quite simple and local CA-models. We would like to emphasize 
that it is not sufficient to somehow simulate or reproduce these quantum 
phenomena numerically on a computer or CA. What is actually called for 
is a structural isomorphism between those phenomena and corresponding 
emergent phenomena on CA. This problem has been one of the reasons 
underlying our interest in CA having a fluctuating time-dependent geometry 
(see below) . We recently observed that ideas about the discrete fine structure 
of space-time similar to our own working philosophy have been uttered in 
chapt. 9 of [8], in particular concerning the existence of what we like to call 
shortcuts or whormhole structure. 

Still another interesting point is discussed by Svozil ([II]), i.e. the well- 
known problem of species doubling of fermionic degrees on regular lattices, 
which, as he argues, carries over to CA. Among the various possibilities 
to resolve this problem he suggests a kind of dimensional reduction ("di- 
mensional shadowing"), which leads in the CA one is actually interested in, 
to non-local behavior (see also [I] p.649ff). It is perhaps remarkable that, 
motivated by completely different ideas, we came to a similar conclusion 
concerning the importance of non-local behavior (cf. [TO], see also |13j). 

While presently the discussion in the physics community, when it comes 
to the high-energy end of fundamental physics, is dominated by string the- 
ory and/or loop quantum gravity, frameworks which are in a conceptual 
sense certainly more conservative, we nevertheless regard an approach to 
these primordial questions via networks and/or CA as quite promising. In 
contrast to the above-mentioned (more conservative) approaches which start 
from continuum physics and hope to detect discrete space-time behavior at 
the end of the analysis (for example by imposing quantum theory as a quasi 
God-given absolute framework on the underlying structures over the full 
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range of scales), we prefer a more bottom-up- approach. One of our reasons 
for this preference is that we do not believe that quantum theory holds sway 
unaltered over the many scales addressed by modern physics down to the 
pristine Planckian regime. Like 't Hooft, we regard quantum theory rather 
as a kind of effective intermediate framework, which emerges from some 
more primordial structure of potentially very different nature. We start from 
some underlying dynamic, discrete and highly erratic network substratum 
consisting of (on a given scale) irreducible agents interacting (or interchang- 
ing pieces of information) via elementary channels. On a more macroscopic 
(or, rather, mesoscopic) scale, we then try to reconstruct the known contin- 
uum structures as emergent phenomena via a sequence of coarse graining 
and/or renormalisation steps (see [13] and |25j). 

While CA have been widely used in modeling complex behavior of molec- 
ular agents and the like (a catchword being artificial life or Conway's game 
of life; for a random selection see e.g. pQ, [15], [16], [17], [18] or [19]), pa- 
pers on the more pristine and remote regions of Planck-scale physics are 
understandably less numerous. 

When we embarked on such a programme in the early nineties of the 
last century, we soon realized that the ordinary framework of CA, typically 
living on fixed and quite regular geometric arrays, appears to be far to rigid 
and regular in this particular context. In order to implement the lessons 
of general relativity we have to make their structure dynamical, that is, 
not only the local states on the vertices of the lattice but also the local 
states attached to the links need to be dynamic. A fortiori, we would like 
the whole wiring diagram of links to be "clock-time dependent" . To put it 
briefly: matter shall act on geometry and vice versa, where we, tentatively, 
associate the pattern of local vertex states with the matter distribution and 
the geometric structure of the network with geometry. 

Our first task therefore is to turn both the site and the link states into 
fully dynamical degrees of freedom, which mutually depend on each other in 
a dynamical and local way. Furthermore, all this is assumed to happen on 
very irregular arrays of nodes and links which dynamically arrange them- 
selves according to some given evolution law. Then the hope is, that under 
certain favorable conditions, the system will undergo a (series of) phase 
transition(s) from, for example, a disordered chaotic initial state into a kind 
of macroscopically ordered, extended pattern, which may be associated with 
a classical continuum space-time with some matter living in it. 

One of our first (published) papers, in which we implemented such a pro- 
gramme was |20| . see also |21| ; for the notion of dimension of such irregular 
structures see [22] . We carefully inspected the literature known to us on C A 
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at the time of writing those papers, but only several years later, when one of 
the authors (M. Requardt) had the pleasure to review the book by Ilachin- 
ski, we became aware of slightly earlier related ideas developed by Ilachinski 
and Halpern (see e.g. pQ or [23] for reviews and further references). In the 
following sections we are going to relate these two originally independent ap- 
proaches to each other and discuss the behavior of two interesting dynamical 
network models we employed and studied in greater detail. Furthermore, 
we give an overview of an extensive numerical and computational analysis 
of these model systems. 

2 A Comparison of SDCA and our Dynamic Cel- 
lular Networks 

2.1 SDCA 

SDCA have been introduced by Ilachinski and Halpern and are straightfor- 
ward generalisations of CA (for a more recent application see e.g. [21] )• In 
the simplest cases they are placed (as most of CA) on a finite or infinite 
regular grid, e.g. 7L d . The generalisation consists of the assumption that 
also the links, connecting the sites of the lattice, can be created and deleted 
according to a local law. More properly, we have link variables, l xy , attaining 
the value 1 if site x is linked to site y and being zero otherwise. 

In this context it is of course of great relevance which sites can be linked 
at all. In [1] or [23], for example, links of the original background lat- 
tice Z 2 belong to this pool together with diagonal links to the next-nearest 
neighbors. In the respective examples some start configuration is chosen on 
the Euclidean background lattice and one can observe, in the course of clock 
time, the emergence of additional diagonal links and the subsequent deletion 
of some of them, as well as deletion and reinsertion of the original horizon- 
tal and vertical links . The local dynamical rule guarantees that only links 
connecting nearest or next-nearest neighbors participate in the process (cf. 
e.g. section 8.3 in [1]). This entails that the change of the wiring diagram 
proceeds still in a rather local and orderly way with respect to the initial 
Euclidean lattice. 

These restrictions are of course not necessary. In general, CA can be 
defined on an undirected graph. At each site x we have attached a site state 
s x , being capable of attaining some discrete values (typically s x € {0,1}) 
while link states l xy can have the values or 1. In SDCA the wiring diagram, 
i.e., the distribution of links, is now also a dynamical evolving structure. A 
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local law, being independent of the constantly varying wiring diagram can 
be formulated by employing the natural graph distance metric given by 

d(x,y) := min{/ 7 } (1) 

with 7 a path, connecting the sites x and y and / 7 its length, i.e., the 
number of links along the path (this distance being infinite if the sites are in 
disconnected pieces of the network). With this metric, the graph becomes a 
discrete metric space. Ball neighborhoods around a site x are then defined 
by 

B r (x):={y,d(x,y)<r} (2) 

(cf. e.g. [22] or [25]). 

For convenience we introduce some notation. The underlying time de- 
pendent lattice (the wiring diagram) is denoted by L t . s x ,l xy (or Si,lik) 
designate the local site or link states (in the simplest case s x G {1,0}, 
Ixy G {1)0})- N(x) is a certain neighborhood of sites and links about the 
site x. A classical CA is given by a local dynamical law or rule, i.e., a 
map from some N(x) to S, the state space at site x. Typically the type 
of neighborhood and the local rule are chosen to be the same over the full 
lattice. 

Things become a little bit more complicated if the wiring diagram is 
chosen to also become (clock) time dependent. In that case it is more rea- 
sonable to define the neighborhoods by the distance metric, i.e., choose some 
B r (x). Note that now the actual site and link content of B r (x) is time de- 
pendent, while the definition of the neighborhood can be given in a time 
independent form. From a mathematical point of view we could formulate 
rather arbitrary local rules, but physics has taught us to avoid too artificial 
or cumbersome rules, which depend on rather ad hoc assumptions. So, quite 
reasonable laws appear to be totalistic or outer-totalistic rules, which act on 
the sum of site states and/or link states in the ball B r {x) with a possible 
particular role played by s x itself. 

In the general case, the dynamics is given by a pair of local laws: 

4 m > = Fxisl e B r (x),li, y , G B r {x)) (3) 
= F 2 {s x , G B r ,(li y ),li, y , G B r ,(lly)), (4) 

in which we have been a bit sloppy in order not to overburden the formulas 
with too many indices. To get an idea how this scheme works in concrete 
examples, see sect. 8.8 of pQ or [23] or the sections below. 



4 



Remark: We would like to emphasize again, that, in the typical examples 
given above, link deletion or creation is restricted to nearest or next-nearest 
neighbors with respect to the background lattice (e.g. Z 2 ). The lattice 
evolution is hence still quite regular. This is of some relevance in comparison 
to our cellular networks, which are capable of developing both local and 
translocal connections with respect to some reference space. 

2.2 Our Dynamic Cellular Networks 

Our networks are defined on general graphs, G, with V(G) the set of vertices 
(sites or nodes) and E{G) the set of edges (links or bonds). The local site 
states can assume values in a certain discrete set. In the examples we have 
studied, we follow the philosophy that the network should be allowed to find 
its typical range of states via the imposed dynamics. That is, we allow the 
Si to vary in principle over the set q ■ Z, with q a certain discrete quantum 
of information, energy or whatever. The link states can assume the values 
■Jik £ { — 1)0, +1} (we are assuming here the notation J ik instead of li k as 
we regard the links as representing a kind of elementary coupling) . 

Viewed geometrically we associate the states = +1,-1,0 with di- 
rected edges pointing from site Xi to x k , or the other way around, or, in the 
last case, with a non-existing edge. That is, at each clock time step, t ■ r (r 
an elementary quantum of time), we have as underlying substratum a time 
dependent directed graph, G t . Our physical idea is that at each clock time 
step an elementary quantum q is transported along each existing directed 
edge in the indicated direction. 

To implement our general working philosophy of mutual interaction of 
overall site states and network geometry, we now describe some particular 
network laws, which we investigated in greater detail (see the following sec- 
tion) . We mainly considered two different classes of evolution laws for vertex 
and edge states: 

• Network type I 



J ik (t + 1) = sign(Asi fc ) for |As ifc | > A 2 V (|As ifc | > Ai A J ik (t) ± 0) 

(6) 




(5) 



k 



J ik (t +1)=0 o.w. 



(7) 
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• Network type II 



(8) 



k 



Jik(t + 1) = sign(As ife ) for < \As ik \ < X 1 V (0 < |As ifc | < A 2 A J ife (t) ^ 0) 

(9) 



where Asjfc = Si(t) — Sk(t) and A2 > Ai > 0. We see that in the first 
case, vertices are connected that have very different internal states, leading 
to large local fluctuations, while for the second class, vertices with similar 
internal states are connected. 

We proceed by making some remarks in order to put our approach into 
the appropriate context. 



1. It is important that, generically, laws, as introduced above, do not lead 
to a reversible time evolution, i.e., there will typically be attractors or 
state-cycles in total phase space (the overall configuration space of 
the node and bond states). On the other hand, there exist strategies 
(in the context of cellular automata!) to design particular reversible 
network laws (cf. e.g. [26] ) which are, however, typically of second 
order. Usually the existence of attractors is considered to be important 
for pattern formation. On the other hand, it may suffice that the phase 
space, occupied by the system, shrinks in the course of evolution, that 
is, that one has a flow into smaller subvolumes of phase space. 

2. In the above class of laws a direct bond-bond interaction is not yet 
implemented. We are prepared to incorporate such a (possibly im- 
portant) contribution in a next step if it turns out to be necessary. 
In any case there are not so many ways to do this in a sensible way. 
Stated differently, the class of possible, physically sensible interactions, 
is perhaps not so large. 

3. We would like to emphasize that the (undynamical) clock-time, t, 
should not be confused with the "true" physical time, i.e., the time 
operationally employed on much coarser scales. The latter is rather 
supposed to be a collective variable and is expected (or hoped!) to 



Jik(t + 1) 



Jik(t) for As ik = 



(10) 
(11) 




Remarks: 
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emerge via a cooperative effect. Clock-time may be an ideal element, 
i.e., a notion which comes from outside, so to speak, but - at least for 
the time being - we have to introduce some mechanism, which allows 
us to label consecutive events or describe change. 

The following observation we make because it is relevant if one follows the 
general spirit of modern high energy physics. 

Observation 2.1 (Gauge Invariance) The above dynamical law depends 
nowhere on the absolute values of the node charges but only on their relative 
differences. By the same token, charge is nowhere created or destroyed. We 
have 



where, for simplicity, we represent the set of sites by their set of indices, I, 
and A denotes the difference between consecutive clock-time steps. Put dif- 
ferently, we have conservation of the global node charge. To avoid artificial 
ambiguities we can, e.g., choose a fixed reference level and take as initial 
condition the constraint 



iei 

We conclude this subsection by summarizing the main steps of our work- 
ing philosophy. 

Resume 2.2 Irrespective of the technical details of the dynamical evolution 
law under discussion, the following, in our view crucial, principles should 
be emulated in order to match fundamental requirements concerning the ca- 
pability of emergent and complex behavior. 

1. As is the case with, say, gauge theory or general relativity, our evolu- 
tion law on the surmised primordial level should implement the mutual 
interaction of two fundamental substructures, put sloppily: "geometry" 
acting on "matter" and vice versa, where in our context "geometry" 
is assumed to correspond in a loose sense with the local and/or global 
bond states and "matter " with the structure of the node states. 

2. By the same token, the alluded self-referential dynamical circuitry of 
mutual interactions is expected to favor a kind of undulating behav- 
ior or self-excitation above a return to some uninteresting 'equilibrium 
state ' as is frequently the case in systems consisting of a single com- 
ponent which directly feeds back on itself. This propensity for the 'au- 
tonomous ' generation of undulation patterns is in our view an essential 




(12) 




(13) 
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prerequisite for some form of "protoquantum behavior " we hope to re- 
cover on some coarse grained and less primordial level of the network 
dynamics. 

3. In the same sense we expect the overall pattern of switched- on and -off 
bonds to generate a kind of "protogravity ". 

3 Numerical Studies 

We now put our two cellular network models on a simplex graph with n 
vertices X{ and edges e^, i, j £ {1, . . . , n}. More specifically, the maximally 
possible number of edges is n(n — l)/2. We choose such a simplex graph 
as initial geometry. As an initial distribution for vertex states (seed) we 
choose a uniform (random) distribution scattered over the interval {— k, —k+ 
1, . . . k — 1, k}. In an early state of the work we also used other (initial) 
distributions as well but we did not find any significantly different results. 
The initial values for edge states were chosen from {—1,1} with equal 
probability 1/2. In other words, our initial state is a maximally entangled 
nucleus of vertices and edges and the idea is to follow its unfolding under the 
imposed evolution laws. In a sense, this is a scenario which tries to imitate 
the big bang scenario. The hope is, that from this nucleus some large-scale 
patterns may ultimately emerge for large clock-time. 

For numerical investigations, the size of the CA is by necessity rather 
limited. To obtain an estimate for properties of the large networks, which 
we are ultimately interested in, we simulated networks of increasing size and 
tried to extrapolate the expected properties for larger networks. The average 
of all vertex states is approximately by construction and the the sum of all 
temporal changes of vertex states is exactly 0. For most other properties we 
found that the average over the width of the initial vertex state distribution, 
over Ai and A2, and over specific realizations of initial conditions as well as 
time, has a linear dependence of the given property on the network size 
n. Figure QJa) shows an example and table Q] summarizes the observed 
dependencies. A few of the quantities did not show linear dependencies, 
see figure [Hb) and (c). While the standard deviation of spatial fluctuations 
has an unknown dependency on network size ([Hb)), the number of "off" 
bonds clearly scales with the number of total edges, i.e., with n 2 . This 
suggests that a random graph approximation with constant probability for 
"off" edges might be possible. 

In most results on a single size network we used n = 200 and k = 100. 



8 



(a) 





800 


-a 


600 








400 


to 




< 


200 



(b) 



I ■ 





250 




200 






CO 


150 








100 


b 






50 



















■ 










■ 








i 




» 























250 500 750 

number of vertices 



250 500 750 

number of vertices 



(C) 



o 

II 



2.5e+05 
2e+05 
1 .5e+05 
'Si 1 e+05 
50000 

f-H 

$ o, 



















* 


► 






■ 








A 


■ * 






■ - m 











250 500 750 1000 

number of vertices 



Figure 1: Examples of the observed dependence of averaged quantities on 
network size. Most quantities scale linearly with network size for both types 
of network laws like illustrated in (a). For some quantities the scaling is 
unclear, as for a(Asik) for network type I shown in (b). The number of 
"off" bonds shown in (c) scales with the total number of bonds, i.e. with 
n 2 . The circles correspond to networks of type I, the squares to networks of 
type II. 



property 


law 


scaling of 

card min mean sigma max 


vertex states Si(t) 


law I 
law II 


0.3 n -0.85 n small 0.85 n 0.5 n 
0.3 n —n small 0.58 n n 


temporal fluctuations Asi(t) 


law I 
law II 


0.15n -0.78n 0.53n 0.78n 
0.54n -0.47n 0.26n 0.47n 


spatial fluctuations Asik(t) 


law I 
law II 


1.4 n 0.55n ? 1.7 n 
1.05n 0.29n 0.21 n l.lOn 


spatial fluctuations As ik (t) , J ik =fc 


law I 
law II 


1.2 n O.ln 0.7n ? 1.7 n 
1.05n 0.29n 0.21 n l.lOn 


vertex degrees degi(t) 


law I 
law II 


0.04 n 0.7 n 0.05 n n-1 
0.23n 0.31n 0.55n 0.08n 0.68n 


temporal fluctuations Adegi(T) 


law I 
law II 


0.03 n -0.12 n small 0.04 n 0.12 n 
0.24 n -0.17 n small 0.07 n 0.18 n 


spatial fluctuations Adegik(t) 


law I 
law II 


O.ln 0.05n ? 0.22n 
0.36 n 0.09 n 0.08 n 0.37 n 


spatial fluctuations Adegik(t), Jik =^ 


law I 
law II 


0.08 n small 0.08 n ? 0.25 n 
0.32 n 0.07n 0.06 n 0.34n 



Table 1: Scaling laws for averaged properties of the two network types. Most 
quantities scale linearly with the number of nodes n. Some scale with the 
square of n, while others have an unknown scaling behaviour, denoted by a 
question mark in the table. 
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3.1 Limit cycles 

Because of the finite phase space of the CA (technically it is infinite, but 
the vertex states only fill a finite interval of Z due to the nature of the 
network laws), network states will eventually repeat, which leads to a limit 
cycle because of the memorydess dynamics. We tested for the appearance 
of such limit cycles for different network size n and to our surprise, networks 
of type I had with very few exceptions extremely short limit cycles of period 
6. The exceptions we were able to find, had periods of a multiple of 6, the 
longest found (in a network with n = 810) was 36. The prevalence of such 
short limit cycles is still an open question and beyond this work. We note 
in this context that already S. Kauffmann observed such short cycles in his 
investigation of switching nets (|15j. |16] ) and found it very amazing. Such 
short cycles were also found in random networks ([21]) in a quite different 
context. 

This phenomenon is remarkable in the face of the huge accessible phase 
spaces of typical models and points to some hidden ordering tendencies in 
these model classes. What is even more startling is that this phenomenon 
prevails also in our case for model class 1 when we introduce a further 
element of possible disorder by allowing edges to be dynamically created 
and deleted. We formulate the following hypothesis. 

Conjecture 3.1 We conjecture that this important phenomenon has its 
roots in the self-referential structure (feed-back mechanisms) of many of the 
used model systems. 

It is instructive to observe the emergence of such short cycles in very small 
models on paper, setting for example Ai = A2 = 0, i.e., no switching-off 
of edges and taking n = 2, 3 or 4. Taking, e.g., n = 2 and starting from 
s 2(0) = s\(0) mod 2, the network will eventually reach a state si(to) = 
S2(to). Without loss of generality we can assume si(to) = ^(^o) = and 
•^12(^0) = 1- This state develops into a cycle of length 6 as illustrated in 
tabled- For si(0) = S2(0) + l mod 2 the state eventually becomes si(t\) = 
S2(t\) + 1, without loss of generality si(ii) = 1, 52(^1) = 5 ^12(^1) = 1> 
resulting in the dynamics in table [2b. Again, the length of the cycle is 6. 
Hence, 6 is a good candidate for a short cycle length, which - of course - 
does not explain why such a short length should appear at all. 

The transients in networks of type I are also rather short and grow slowly 
with the network size (data not shown). 

Networks of type II have much longer limit cycles and transients. Be- 
cause of numerical limitations we were only able to determine cycle lengths 
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Figure 2: Limit cycle dynamics of a minimal network of 2 vertices, b) Length 
of transients and limit cycles in networks of type II. 

for small networks. As shown in figure [2b) the typical transient and cycle 
lengths both grow approximately exponentially. 

3.2 Vertex degrees and internal states 

To characterize the networks resulting from the two different evolution laws, 
we measured several key quantities, including the distribution of node de- 
grees (also called the vertex degree sequence), the distribution of node states 
Xi, the distribution of bond states Jij, as well as temporal and spatial fluc- 
tuations of these quantities. The vertex degree distribution in dependence 
on Ai for a network of 200 vertices is shown in figure [3^) and b) for network 
law I and II respectively. The second parameter was fixed as A2 = 1.2 • Ai 
to implement a reasonable hysteresis in the dynamical addition and removal 
of edges and the degrees were observed after a transient of 10 time steps, 
i.e., prevalently still in a transient dynamics regime. The network structure 
undergoes a series of changes for increasing A]y 2 - 

Networks of type I evolve from almost fully connected simplex networks 
to more sparse connectivities with increasing X\/2- There is a regime, where 
few vertices with very high degree coexist with many vertices with a low 
degree (around Ai = 60), which is reminiscent of the situation in small 
world networks. We, however, observe a bimodal distribution (with very 
sharp peaks in each given network, see figure [3]) rather than a power law of 
abundance of node degrees. For large A1/2 the network eventually breaks 
apart and all nodes have vertex degree 0. 

For networks of type II the situation is - as expected - inverse with 
respect to Ai/2- The networks are trivial with vertex degree for all nodes 
for small A1/2 an d connect increasingly dense for increasing Ai/2- in this 
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Figure 3: Distribution of abundance of node degrees in dependence on Ai 
(a: network type I, b: network type II). The second parameter was fixed 
to A2 = 1.2 • Ax, n = 200, and the total abundances shown are collected 
over 10990 different initial conditions. I.e., for each Ai (y axis) the colors 
of the pixels show the number of times the node degree (corresponding to 
the x position) appeared in the set of graphs generated with 10990 initial 
conditions. Note the logarithmic scale on the color scale and the y axes of 
the examples. 



family of networks, the distribution of vertex degrees is always fairly broad 
and remains such up to large \\/2- We observe an intriguing structure of 
multiple maxima of the distributions in a wide range of A1/2 values. 

The observed structure of groups of highly connected and less connected 
vertices in the averaged distributions may arise from each given network 
realization having these two groups of vertices or appear due to the existence 
of two different types of networks. To probe these possibilities, we examined 
the abundance distribution of node degrees for individual initial conditions 
(Fig. HI). In all examples we observe the same structure as in the averaged 
picture (Fig. [3}a), such that we have to conclude that there is only one 
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Figure 4: Distribution of abundance of node degrees in network I for three 
separate examples of initial conditions, dependent on Ai (again A2 = 1.2 • Ai 
and n = 200). Note again the logarithmic color scale. All examples reflect 
the overall structure of the averaged data, thus showing that the appearance 
of hubs with large vertex degree and vertices with small degree actually 
occurs within the same network and at the same time and is not an artifact 
of averaging over many initial conditions 

type of network for a given Ai,A2 pair that has a structured vertex degree 
distribution. Furthermore, careful examination shows that this distribution 
can - unlike in the averaged picture - be fairly sharp, with often only one 
or two prevalent values for the vertex degree. The same is true for networks 
of type II: Distributions resemble the averaged picture but often with sharp 
peaks for a single value for the vertex degree (data not shown). 

The temporal fluctuations, degj(t + 1) — degj(i), of vertex degrees give 
us insight into the stability of the network structure. For network law I we 
observe at Ai ~ 35 an abrupt phase-transition from basically no temporal 
fluctuations in the node degrees ("frozen network") to fairly high fluctua- 
tions ("liquid network"). For even larger A, the fluctuations slowly abate in 
agreement with the smaller overall vertex degrees. It is surprising that the 
transition is so abrupt especially in the face of the much smoother develop- 
ment of the distribution of vertex degrees (Fig. [3]). 

While the node degrees instruct us on the geometry of the CA graph, 
i.e., presumably on the structure of space, the state variables Sj tell us 
something about an "energy" or "mass" density in some appropriate sense. 
As explained above the sum over local states, ^ 7 Sj, is conserved, and hence 
is the sum of changes Yli = 0- This does, however, not imply that the 
distribution of s, or changes in Sj are trivial. Figure [6] shows the maps 
for different node value distributions depending on Ai € {1, . . . , 111} and 
A 2 = 1.2Ai. 

The results expected, very different for the two network types. 

Networks of type I have a clear region of intermediate A values where the dis- 
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Figure 5: Distribution of abundance of temporal changes in node degrees de- 
pendent on Ai (again A2 = 1.2 • Ai and n = 200). Note again the logarithmic 
color scale. 

tribution of node states is strongly bimodal for 62 < Ai < 85. For smaller A, 
i.e., for less bonds being switched off, there is a broad distribution of node 
states, and for larger A values, we observe a sharp unimodal distribution 
around corresponding to disconnected graphs, in which the node states 
are basically frozen in their initial values. Intriguingly, the transitions be- 
tween the different types of state distributions occur at sharp values of A 
reminiscent of phase transitions. 

Networks of type II have no bimodal distributions of node values, but 
there is a visible modulation in the width of node state distributions with 
different values of Ai. For some A values, the distribution of observed states 
is rather sharp, for others rather wide. It is also interesting to note that, 
contrary to the naive expectation, the total width of the distributions is 
slightly larger than for networks of type I (note the light blue left and right 
tails for Ai ~ 60). The fact that nodes with similar node state are con- 
nected and can reach some equilibrium and nodes with very different states 
are separate and can not interact (equilibrate) directly seems to allow such 
"outlier" states. 

4 Dimensionality 

When studying such models as described above, it is of tantamount im- 
portance to find certain effective geometric characteristics of the large scale 
behavior of such irregular (in the small) networks. This holds the more so 
if one plans to perform some coarse- graining or continuum limit. It is evi- 
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Figure 6: Distribution of abundance of node states in dependence on Ai 
(again A2 = 1.2 • Ai and n = 200). As before, each line corresponds to a 
fixed pair of Ai,A2 and shows a distribution of observed node states in a 
logarithmic color code. Dark red pixels correspond to node states that are 
observed very often, and dark blue are states that are never observed. 

dent that, in particular in the latter situation, only global features can be 
significant while, on the other hand, the finer details on small scales should 
be ignored. 

The notion of dimension is one of these fundamental organizing concepts. 
There exist of course quite a few different versions of this concept in the 
mathematical literature, most of which, while looking useful at first glance, 
have to be dismissed on second thoughts. We will not give the pros and cons 
of all the different notions (a more detailed discussion can e.g. be found in 
[22j and [25]), let us only make the following point clear. The discrete models 
we are dealing with are not to be understood as some sort of tessellation of 
a preexisting continuous background manifold like in algebraic topology. In 
that case it would for example be reasonable to use the dimensional concept 
employed in simplicial complexes. 

In our case, exactly the opposite is true. We view the continuum as an 
emergent limit structure, being the result of a (complicated) renormalisation 
group like process of coarse-graining. In this process, due to the rescaling 
of geometric scales, more and more vertices and links are absorbed in the 
infinitesimal neighborhoods of the emerging points of the continuum. As a 
consequence, what amounts to a local definition of dimension in the contin- 
uum is actually a large scale concept on the network, involving practically 
infinitely many vertices and their wiring. 

Halpern and Ilachinski make a certain suggestion in their work (see e.g. 
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|23j). which also happens to be a distinctly local concept. They define the 
effective dimensionality as the ratio of the number of next-nearest neighbors 
to the number of nearest neighbors averaged over the set of sites of the 
network. It is a typical property of most of the different dimensional concepts 
that they usually coincide on very regular spaces. This is for example well- 
known for the various notions of fractal dimension (cf. e.g. [28] or [29]). For 
the notion introduced above we have for instance in the case of Z 2 : N nn (x) = 
8,N n (x) = 4, i.e. Dm = 2 and correspondingly for higher dimensions. 
However, for other lattices which are not so regular or translation invariant, 
i.e. having a more complicated local neighborhood structure, this is no 
longer true. While one would still like to associate on physical grounds in 
many cases their dimension with the corresponding embedding dimension 
of the ambient space, the above quotient may yield a different value. 

The deeper reason is that the accidental near-order of the lattice may 
differ from its more important far-order. This phenomenon and the following 
physical argument motivated us to choose a different notion of intrinsic 
dimension which has a lot of very nice and desirable properties as has been 
shown in the papers we cited above. Originally we were primarily motivated 
by the following reasoning. What kind of intrinsic global property (i.e. 
being independent of some embedding dimension or accidental near-order) 
is relevant for the occurrence of phase transitions, critical behavior and the 
like? We wound up with the following answer: It is the increase of number 
of new agents or degrees of freedom one sees when one starts from a given 
lattice site and moves outward. This led to the following definition ( note 
that we introduce two slightly different notions which again coincide in many 
cases) . 

Definition 4.1 The (upper, lower) internal scaling dimension with respect 
to the vertex x is given by 

D s {x) := limsup(ln/3(x,r)/lnr) , D s (x) := liminf(ln/3(x,r)/lnr) (14) 

r — >oo r 

The (upper, lower) connectivity dimension is defined correspondingly as 
D c (x) :=limsup(lnd/3(x,fc)/lnfc) + l , D k [x) := liminf (ln/3(z, k)/ln k) + 1 

k~ >oo k^oo 

(15) 

If upper and lower limit coincide, we call it the internal scaling dimension, 
the connectivity dimension, respectively. 

In [25] we exhibited the close connection of this concept with important 
properties in various fields of pure mathematics (growth properties of metric 
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spaces). Furthermore, when performing some continuum limit we could 
show that our notion of dimension makes contact with the various notions 
of fractal or Haussdorff -dimension. 

5 Discussion 

In the preceding sections we introduced and studied networks which are 
in various respects generalisations of structural dynamic CA, i.e., networks 
with both the site states and the wiring (link-distribution) being dynamic 
and (clock) time dependent. We thus realize an entangled dynamics of geom- 
etry and matter degrees of freedom as in, say, general relativity or quantum 
gravity. In contrast to more ordinary CA we admit a very high degree of dis- 
order in the small while we hope that our network models find an attracting 
set in phase space after some transient time, thus displaying some patterns 
of global order. We are particularly interested in ordering phenomena on the 
geometric side. That is, we look for collective geometric properties like, e.g., 
dimension, which suggest that, after some coarse graining and/or rescaling, 
our networks display global smoothness properties which may indicate the 
transition into a continuum-like macro state. 

We underpin our investigation by a quite detailed quantitative computa- 
tional analysis of various (large scale) characteristics of our model networks 
as, e.g., vertex degree distribution, fluctuation patterns in site and/or link 
states, etc. There are indications that for certain choices of the parameters, 
labelling our model networks, we witness something akin to structural phase 
transitions. 

It is particularly noteworthy that one of our model networks (after a very 
short transient time) enters a periodic state of period only six, and this being 
practically independent of the chosen initial state. Given the huge possible 
local fluctuations in both site states and link distribution the extremely 
short period is remarkable. This phenomenon has also been observed in 
other kinds of networks but nevertheless remains somewhat mysterious. 
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